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Abstract 



Many crucial biological processes operate with surprisingly small numbers 
of molecules, and there is renewed interest in analyzing the impact of noise 
associated with these small numbers. Twenty-five years ago, Berg and Pur- 
cell showed that bacterial chemotaxis, where a single celled organism must 
respond to small changes in concentration of chemicals outside the cell, is 
limited directly by molecule counting noise, and that aspects of the bacte- 
ria's behavioral and computational strategies must be chosen to minimize the 
effects of this noise [1]. Here we revisit and generalize their arguments to 
estimate the physical limits to signaling processes within the cell, and argue 
that recent experiments are consistent with performance approaching these 
limits. 
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I. INTRODUCTION 



A striking fact about biological systems is that single molecular events can have macro- 
scopic consequences. The most famous example is of course the storage of genetic informa- 
tion in a single molecule of DNA, so that changes in the structure of this single molecule 
(mutations) can have effects on animal behavior and body plan from generation to genera- 
tion [2]. But there also are examples where the dynamics of individual molecular interactions 
can influence behavior on much shorter time scales. Thus we (and other animals) can see 
when a single molecule of rhodopsin in the rod cells of the retina absorbs a photon [3], and 
some animals can smell a single molecule of airborne odorant [4] . Even if a single molecular 
event does not generate a specific behavior, it may still be that the reliability of behavior is 
limited by inevitable fluctuations associated with counting random molecular events. Thus 
the visual system has a regime where perception is limited by photon shot noise [5,6], and 
the reliability with which bacteria can swim up a chemical gradient appears to be limited 
by noise in the measurement of the gradient itself [1]. It is an open question whether bio- 
chemical signaling systems within cells operate close to the corresponding counting noise 
limits. 

The classical analysis of bacterial chemotaxis by Berg and Purcell provided a simple 
estimate and a clear intuitive picture of the noise in 'measuring' chemical concentrations. 
Their argument was that if we have a sensor with linear dimensions a, we expect to count an 
average of N ~ ca 3 molecules when the mean concentration is c. Each such measurement, 
however, is associated with a noise 5Ni ~ v^/V. A volume with linear dimension a can be 
cleared by diffusion in a time r D ~ a 2 / D, so if we are willing to integrate over a time r we 
should be able to make iV meas ~ t/td independent measurements, reducing the noise in our 
estimate of N by a factor of V^mcas- The result is that our fractional accuracy in measuring 
N, and hence in measuring the concentration c itself, is given by 



5c 



5N 1 



1 
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A crucial claim of Berg and Purcell is that this result applies when the sensor is a single 
receptor molecule, so that a is of molecular dimensions, as well as when the sensor is the 
whole cell, so that a ~ 1 /im. In particular, imagine a cell of radius R which has receptor 
molecules of size a on its surface. With just one receptor the limiting concentration resolution 
must be 5c/ c ~ (Dacr) -1 / 2 , and if N r receptors are distributed sparsely over the cell surface 
we expect that they provide independent measurements, improving the resolution to 5c/ c ~ 
(DN r acT)~ l l 2 . But as iV r increases to the point where N r a ~ R, this must saturate at 
5c/ c ~ (DRct)" 1 / 2 , presumably because of correlations among the concentration signals 
sensed by the different receptors. 

The discussion by Berg and Purcell makes use of several special assumptions which we 
suspect are not required, and this leads to some clear questions: 

• For interactions of a substrate with a single receptor, does Eq. (1) provide a general 
limit to sensitivity, independent of molecular details? 

• Can we understand explicitly how correlations among nearby receptors result in a limit 
like Eq. (1), but with a reflecting the size of the receptor cluster? 

• Do the spatial correlations among nearby receptors have an analog in the time domain, 
so that there is a minimum averaging time required for noise reduction to be effective? 

Finally, if we can establish Eq. (1) or its generalizations as a real limit on sensitivity for any 
signaling process, we would like to know if cells actually operate near this limit. 

In most cases that we know about, biochemical signaling molecules are thought to inter- 
act with their receptors through some kinetic process which leads to the establishment of 
equilibrium between bound and unbound states. If this is the case, we can view the fluctu- 
ations in occupancy of a binding site as an example of thermal noise, and we can use the 
fluctuation-dissipation theorem rather than tracing through the consequences of different 
microscopic hypotheses about the nature of the interaction between signaling molecules and 
their targets. We begin with a simple example, to show that we can recover conventional 
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results. 



II. BINDING TO A SINGLE RECEPTOR 

Consider a binding site for signaling molecules, and let the fractional occupancy of the 
site be n. If we do not worry about the discreteness of this one site, or about the fluctuations 
in concentration c of the signaling molecule, we can write a kinetic equation 

< ^- = k + c[l-n{t)]-k.n{t). (2) 

This describes the kinetics whereby the system comes to equilibrium, and the free energy F 
associated with binding is determined by detailed balance, 

k+c 



k_ 6XP fej • (3) 

If we imagine that thermal fluctuations can lead to small changes in the rate constants, we 
can linearize Eq. (2) to obtain 

cLSti 

— — = -{k + c + k-)5n + c(l - n)5k + - n5k_. (4) 

(JjL 

But from Eq. (3) we have 

5k+ _ 5k_ 5F 

~k^~l~ ~ k^f' ^ ' 

Applying this constraint to Eq. (4) we find that the individual rate constant fluctuations 
cancel and all that remains is the fluctuation in the thermodynamic binding energy SF: 

_ = -(k + c+k^)5n + k + c{l-n)—. (6) 

Fourier transforming, 

Sn(t) — [ exp(—iut) 5h{u) , (7) 
J 2n 

we can solve Eq. (6) to find the frequency dependent susceptibility of the coordinate n to 
its conjugate force F, 



Sn(u) 



k,c(l — n) 



(8) 



5F(lu) k B T -iu + (k+c + fc_) 
Now we can compute the power spectrum of fluctuations in the occupancy n using the 
fluctuation-dissipation theorem: 

duj 
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It is convenient to rewrite this as 



where the total variance is 



S n (u) = ((Sn) 2 ) 



2r, 



l + (^r c ) 2 ' 



(12) 



((H 2 ) = / ^S n (u) = k B T^l 

k + c(l — n) 
k + c + A;_ 
= n(l — n), 



SF(u) 



(13) 

(14) 
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and the correlation time is given by 



(16) 



k + c + k. 

This is the usual result for switching in a Markovian way between two states; here it follows 
from the 'macroscopic' kinetic equations, plus the fact that binding is an equilibrium process. 

The same methods can be used in the more general case where the concentration is 
allowed to fluctuate. Now we write 

dn(t) 



dt 



k + c(x , t)[l — n(t)\ — k_n(t), 



(17) 



where the receptor is located at x , and 

dc(x, t) 



— = DV 2 c(x,t)-5(x-x )^. 



(18) 



Following the same steps as above, we find the linear response function 
8h{u) k + c(l — n) 1 



(19) 
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SM = M1 -,)/___ 1 ^ (20) 

The "self-energy" £(u;) is ultraviolet divergent, which can be traced to the delta function in 
Eq. (18); we have assumed that the receptor is infinitely small. A more realistic treatment 
would give the receptor a finite size, which is equivalent to cutting off the k integrals at some 
(large) A ~ ir/a, with a the linear dimension of the receptor. If we imagine mechanisms 
which read out the receptor occupancy and average over a time r long compared to the 
correlation time r c of the noise, then the relevant quantity is the low frequency limit of the 
noise spectrum. Hence, 

S(c«D/a 2 )^S(0) = ^l^, (21) 



and 



8n{uj) k + c(l — n) 



. / k+(i-n)\ n , ; 



(22) 



SF(u) k B T 

where c is the mean concentration. Applying the fluctuation-dissipation theorem once again 
we find the spectral density of occupancy fluctuations, 

We note that the total variance in occupancy is unchanged since this is an equilibrium 
property of the system while coupling to concentration fluctuations serves only to change 
the kinetics. 

Coupling to concentration fluctuations does serve to renormalize the correlation time of 
the noise, 

r c ^r c [l + E(0)]. (24) 

The new r c can be written as 



1 — n nil — n 

Tr. = — + 
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so there is a lower bound on r c , independent of the kinetic parameters k±, 

n(l — n) 



T, > 
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Again, the relevant quantity is the low frequency limit of the noise spectrum, 

1 + 2(0) 
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If we average for a time r, then the root-mean-square error in our estimate of n will be 

5n Tms = ]Js n (0)-^ (29) 

and we see that this noise level has a minimum value independent of the kinetic parameters 
k±, 

n(l — n) 



on rms ■' , — — — . — 
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(30) 



To relate these results back to the discussion by Berg and Purcell, we note that an overall 
change in concentration is equivalent to a change in F by an amount equal to the change in 
chemical potential, so that Ac/c = AF/k B T. This means that there is an effective spectral 
density of noise in measuring c given by 
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(31) 



where the 'noise force' spectrum Sp(ui) is given by the fluctuation-dissipation theorem as 



S F (u>) = S^l 
V ; 5F(uj) 

In the present case we find that 



S n (u) 
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As before, the accuracy of a measurement which integrates for a time r is set by 



6c nDB = ^Sf(0)-p (34) 

and we find again a lower bound which is determined only by the physics of diffusion, 

5c 1 

> - (35) 
c v irDacr 

Note that this is (up to a factor of y/n) exactly the Berg-Purcell result in Eq. (1). 



III. BINDING TO MULTIPLE RECEPTORS 

To complete the derivation of Berg and Purcell's original results, we consider a collection 
of m receptor sites at positions x^. 

= k + c(x„ t) [1 - n„(f )] - fc_n„(f) (36) 



. . _ . icuA , s iuo J^, 5n u (cu) r 00 sin (A; |x — xJ) „ 



From Eq. 37, we can write 

icuA x~ / \ , ^m^) /"^ & sin (A; |x — :r M |) 

where A is the cut-off wave number; as before, the cut-off arises to regulate the delta function 
in Eq. 37, and is related to the size of the individual receptor. In the limit (u/D) 1 ^ 2 <C 1, 
we have 

x ( -> \ iujA x~ / \ , iuj /on^ 
") = 2^D 6nAuj) + 4^ ^ i^l ' (39) 

and combining with Eq. 36 in Fourier space, we obtain 



-iuj 5N = - 



(k + c + k_) - 



iuAk + (l — n) 



5N 



iuk+(l - ft) ^ ^ „_ 1 . / <5F 
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(40) 



where we have defined 5N(uj) = Y^=i Sri^u), and assumed the steady state fractional 
occupancies to be independent of the receptor site, n^ — n — k + c/ (k + c + k ) . 

If we consider receptor cluster geometries such that the innermost sum is independent 
of x u , we can write the sum as 

E E Sn„ — — = 0(m) • 5N (41) 



v=\ l X M X 



where 



m i 

<t>{m) = E T^T^l ■ (42) 

From the fluctuation-dissipation theorem, we find the spectrum of 5F and convert that to 
an equivalent concentration error as in Eq. 33: 

forms > 1 (—+ V2 (43) 

c \Jt\Dct \mn 2m J 
For example, for receptors of radius b uniformly distributed around a ring of radius a > b, 
we have 0(m) = mg /a, where go is a geometric factor of order unity, and 

^ > -±= ( J- + ^ V' 2 . (44) 
c ^ttDct \mb 2a) 

In summary, we find that the simple formula in Eq. (1) really does provide a general 

limit on the precision of concentration measurements by sensors of linear dimension ~ a, at 

least in those cases where the interactions between the receptor and its ligand are passive. 

Further, there is a minimum level of receptor occupancy noise from Eq. (30), and a minimum 

correlation time from Eq. (26). Let us look at two examples to see how these limits compare 

with the performance of real cellular signaling mechanisms. 

IV. PHYSICAL EXAMPLES 
A. Regulation of gene expression in bacteria 



Expression of genes is controlled in part by the occupancy of promoter sites adjacent to 
the regions of DNA which code for protein [7] . We thus can view gene expression as a readout 
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mechanism for sensing promoter site occupancy, or even as a sensor for the concentration 
of the transcription factor proteins which bind to the promoter site. In a bacterium like E. 
coli, transcription factors are present in Ntf ~ 100 copies in a cell of volume of ~ 1 /zm 3 
[8]. If the transcription factor is a repressor then gene expression levels are determined by 
1 — n, while if it is an activator then expression is related to n; because 5n Tms oc n(l — n) 
[Eq. (30)], fractional fluctuations in either A = noiA = \ — n are determined by 

A ^ ^ V nDacr ^ ^ 

Direct measurements of diffusion constants for small proteins in the E. Coli cytoplasm yield 
D ~ 3/im 2 /s [9]. A promoter site itself has linear dimensions a ~ 3 nm, and putting these 
factors together we find the crucial combination of parameters nDac ~ 3 s^ 1 . In particular 
this means that the fluctuations in occupancy of the promoter site, averaged over a time r, 
are given by 

5 A , . . -. / 100 \ 1/2 /30SX 1 / 



T> (o.xj.d -A)-{—) ■[-) (46) 

Recent experiments [10] indicate that E. Coli achieves ~ 10% precision in control of gene 
expression at small values of A. For this performance to be consistent with the physical 
limits, the transcription machinery must therefore integrate the promoter site occupancy for 
times of order one minute, even assuming that the translation from occupancy to expression 
level itself is noiseless. This integration can be provided by the lifetime of the mRNA 
transcripts themselves, which is ~ 3min in prokaryotes [11]. 



B. Control of the flagellar motor by CheY 

The output of bacterial chemotaxis is control of the flagellar rotary motor [12]. The phos- 
phorylated form of the signaling protein CheY (CheY-P) binds to the motor and modulates 
the probability of clockwise versus counterclockwise rotation [13]. Recent measurements [14] 
show that the probability p of clockwise rotation depends very steeply on the concentration 
c of CheY-P, 
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with h ~ 10 and ci/ 2 ~ 3/zM. Motors switch between clockwise and counterclockwise 
rotation as a simple random telegraph process, and for c ^ Ci/ 2 the switching frequency is 
/ 1.5 s -1 . If we view the motor as a sensor for the internal messenger CheY, then the 
observed behavior of the motor determines an equivalent noise level of 



rms ~[dc 



p(l-p)-(^) , (48) 



where r is the correlation time of the motor state; for the simple telegraph model it can be 
shown that r = 2p(l —p)/f. Using Eq. (47) we find 



5c 1 



*V/r <49) 
Thus, for c ~ ci/2, a single motor provides a readout of CheY-P concentration accurate to 
~ 10% within two seconds. Given the dimensions of the flagellar motor's C ring, a ~ 45 nm, 
with m ~ 34 individual subunits to which the CheY-P molecules bind [15], from Eq. 44 we 
find 

^~ir^V /2 , (so) 



22 V t J 

where we have taken the size of the individual receptor binding site to be b ~ 1 nm, and 
D ~ 3yum 2 /s as above. Hence, the collection of receptors comprising the motor are able 
to measure the CheY-P concentration with ~ 5% precision within two seconds. This is in 
agreement with our earlier result obtained by observing the switching statistics of the motor 
to within a factor of two. 



V. CONCLUDING REMARKS 

In conclusion, we have derived from statistical mechanics considerations the physical 
limits to which biological sensors that rely on the binding of a diffusing substrate can mea- 
sure its concentration. Our approach complements and extends the classic work by Berg and 
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Purcell. For a single receptor, we arrive at their earlier intuitive result, which states that the 
accuracy in measurement of concentration is limited by the noise associated with the arrival 
of discrete substrate molecules at the receptors. Our approach extends in a straightforward 
way to multiple receptors without relying on additional considerations; for this case, our 
result demonstrates more transparently the role of multiple receptors in improving the mea- 
surement accuracy, as well as the saturating limit in this improvement set by the receptor 
cluster size. Relevant internal or external signaling molecules are often present in low copy 
numbers, and their concentration in turn regulates downstream biochemical networks crucial 
to the cell's functions. For two experimentally well-studied examples, we show that the cell's 
performance is consistent with the counting noise limits in measuring the concentration of 
these signaling molecules. 
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